SPECIFICATION 



Electronic Version 1 .2.8 
Stylesheet Version 1 .0 

COMBINATION COMPRESSION AND 
REGISTRATION TECHNIQUES TO 
IMPLEMENT TEMPORAL 
I SUBTRACTION AS AN APPLICATION 

SERVICE PROVIDER TO DETECT 
I CHANGES OVER TIME TO MEDICAL 
I IMAGING 

[ : Background of Invention 

J§001] The present invention relates generally to medical diagnostic imaging systems and, more 
particularly, to a technique for temporal analysis of images. The present technique utilizes 
image compression techniques and a remote applications server to perform image matching 
and subtraction remotely and independently from the client-side computing system. 

[0002] 

Medical diagnostic and imaging systems are ubiquitous in modern health care facilities. 
Currently, a number of modalities exist for medical diagnostic and imaging systems. These 
include computed tomography (CT) systems, x-ray systems (including both conventional and 
digital or digitized imaging systems), magnetic resonance (MR) systems, positron emission 
tomography (PET) systems, ultrasound systems, nuclear medicine systems, and so forth. Such 
systems provide invaluable tools for identifying, diagnosing and treating physical conditions 
and greatly reduce the need for surgical diagnostic intervention. In many instances, these 
modalities complement one another and offer the physician a range of techniques for imaging 
particular types of tissue, organs, physiological systems, and so forth. Health care institutions 
often dispose of several such imaging systems at a single or multiple facilities, permitting its 
physicians to draw upon such resources as required by particular patient needs. In many 
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instances, final diagnosis and treatment proceeds only after an attending physician or 
radiologist has complemented conventional examinations with detailed images of relevant 
areas and tissues via one or more imaging modalities. 



[0003] It is often desirable to compare physiological images of a patient over a period of medical 
treatment to evaluate any physiological changes in the patient, the progress of a disease (e.g., 
cancer), or the effectiveness of a medical treatment. The present approach is to use image 
subtraction techniques to obtain an image highlighting the temporally changed areas in a series 
of medical images. For example, an image obtained six months ago may be subtracted from a 
r current image to highlight (or reveal) a cancerous growth in a subject Unfortunately, the 

; i ; images may be stored at many different health facilities in which the patient sought treatment 

£r and/or medical imaging. Moreover, each facility may have different operating systems, medical 

systems, image storage systems and so forth. These incompatibilities and the geographically 
:0 ' scattered storage of medical images complicate the temporal analysis of medical diagnostic 
^ images, which are typically stored as very large files (e.g. 10MB). 

p)004] Accordingly, there is a need for a technique for temporal analysis of medical diagnostic 
*£; images that is independent of the particular platform utilized at a medical facility. More 

! u particularly, a technique is needed for remotely processing medical diagnostic images and for 

integrating medical imaging and storage systems at a plurality of medical facilities. 

Summary of Invention 

[0005] present technique involves remote processing and comparison of medical diagnostic 

images obtained over a period of time. A remote processing system is provided to match and 
subtract the medical diagnostic images, which may be received from users and gathered from 
remote image storage systems. Users are able to interact with the remote processing system 
through uniform interfaces, which may be disposed at medical institutions to provide platform 
independent interaction with, and remote processing by, the remote processing system. The 
technique also uses compression routines to facilitate network transfers of images between the 
uniform interface and the remote processing system. An aspect of the present technique 
provides a method for processing images produced by medical diagnostic imaging systems. 
The method includes compressing at least one image of a plurality of temporally distinct 
medical images of desired physiological features. The method also includes transmitting the 
plurality of temporally distinct medical images to a remote processing system via a network. An 
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image is also generated from the plurality of temporally distinct medical images to highlight 
temporal differences of the desired physiological features between the image pair. 

[0006] Another aspect of the present technique provides a method for temporal analysis of 

medical diagnostic images, The method includes compressing a plurality of temporally distinct 
medical diagnostic images of desired physiological features. The plurality of temporally distinct 
medical diagnostic images are then electronically transmitted to a remote processing system. 
At the remote processing system, the desired physiological features of at least two images of 
the plurality of temporally distinct medical diagnostic images are geometrically matched. The 
method also includes generating an image from the at least two images to highlight 

; S physiological differences between the at least two images, 

10007] Another aspect of the present technique provides a method for remotely performing a 
tu comparative analysis of a plurality of medical diagnostic images obtained over a time period. 

O The method includes gathering medical diagnostic images at a remote processing system via a 

!L network. At least two images of the medical diagnostic images are then processed at the 

W remote processing system to generate a temporal analysis image illustrating physiological 

jf differences between the at least two images. 

P008] Another aspect of the present technique provides a system for remotely processing medical 
diagnostic images. The system includes a remote processing system configured to compare a 
plurality of medical images and to highlight temporal differences between at least two images 
of the plurality of medical images. The system also has a uniform interface for interacting with 
the remote processing system via a network. An image compression module, which is 
accessible by the uniform interface, is also provided for compressing at least one image of the 
plurality of medical images. 

[0009] Another aspect of the present technique provides a system for platform independent 
processing of medical diagnostic images. The system includes an applications server 
configured to execute temporal image analysis requests from remote platform independent 
interfaces. The applications server has an image matching module configured for geometrically 
matching desired physiological features in at least two images obtained over a time period, The 
applications server also has an image subtraction module configured for subtracting a first 
image from a second image of the at least two images. 
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Brief Description of Drawings 

[001 0] The foregoing and other advantages of the invention will become apparent upon reading 
the following detailed description with reference to the drawings in which: 

[001 1] Fig. 1 is a diagram of the present technique, illustrating an exemplary system for 

communication and data exchange between a plurality of medical clients and a data processing 
center remote from the medical clients; 

[001 2] Fig. 2 is a diagram of the present technique, illustrating an exemplary data flow between 
the data processing center and a client; 

;f|01 3] Fig. 3 is a diagram of the present technique, illustrating an alternate data flow between the 

& data processing center, the client and image storage systems; 

\io] 4] Figs. 4A & 4B are flow charts illustrating an exemplary image processing routine of the 
present technique; 

pOl 5] Fig. 5 is a flow chart illustrating an exemplary image compression routine of the present 

^ technique; and 

2)01 6] Fig. 6 is a flow chart illustrating an alternate processing routine of the present technique. 

Detailed Description 

[001 7] Turning now to the drawings, and referring first to Fig. 1 , a communication system 1 0 is 

illustrated for providing remote data processing for a plurality of healthcare providers having a 
plurality of medical resources, such as medical diagnostic systems 1 2. In the embodiment 
illustrated in Fig. 1 , the medical diagnostic systems 1 2 include a magnetic resonance imaging 
(MRI) system 14, a computed tomography (CT) system 16, and an ultrasound imaging system 
1 8. The diagnostic systems 1 2 may be positioned in a single location or facility, such as 
institutions #1 through #N (e.g., medical facility 20), or may be remote from one another as 
illustrated for ultrasound imaging system 1 8. Each medical facility also may gain remote access 
to a data processing center 22 via the communication system 10. The data processing center 
22 also may be accessible via a remote client unit 24. Accordingly, the present technique 
provides a uniform interface (e.g., thin client or other platform independent interface) for 
interacting with the data processing center 22 to serve multiple clients, facilities and imaging 
systems. 
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[001 8] In the exemplary embodiment of Fig. 1 , several different medical clients (e.g., institutions 
#1 through #N) are provided with remote access to the data processing center 22. These and 
other medical clients may be provided access to, and benefit from, the data processing center 
22, depending upon the capabilities of the data processing center 22, and other factors. 
However, the present technique is particularly well suited for remotely processing client data 
(e.g., images) associated with a wide variety of medical diagnostic system modalities, including 
MR | systems, CT systems, ultrasound systems, positron emission tomography (PET) systems, 
nuclear medicine systems, and so forth. Moreover, the medical clients utilizing the data 
processing center 22 in accordance with the present techniques may be in different medical 
« fields, may have different medical resources, and may have different types of patients. For 

example, medical resources may include a variety of medical equipment, systems, instruments 
Si and human resources for a particular medical procedure or medical practice. Furthermore, 
"V medical resources may include real estate, office space, healthcare service capacity, and 

6 financial resources of a particular institution. A variety of client data may be transmitted to the 

rk data processing center 22 via the communication system 1 0. For example, the client may 

transmit images generated by medical diagnostic imaging systems, patient files from a 
I:; computer, or data entered from a client computer (e.g., a thin client) coupled to the 

f: communication system 1 0 (e.g., remote client unit 24). 



[0019] 



The medical resources, as noted above, may comprise a variety of medical systems. 
Depending upon the modality of the systems, various subcomponents or subsystems will be 
included. In the case of MRI system 14, such systems will generally include a scanner 26 for 
generating pulsed magnetic fields and for collecting signals from emissions by gyromagnetic 
material within a subject of interest. The scanner is coupled to a control and signal detection 
circuit 28 which, in turn, is coupled to a system controller 30. The system controller 30 also 
may include a uniform platform for interactively exchanging client data and processing 
requests with data processing center 22. The system controller 30 is linked to a 
communications module 32, which may be included in a single or separate physical package 
from system controller 30. System controller 30 is also linked to an operator station 34, which 
will typically include a computer monitor 36, a keyboard 38, as well as other input devices 40, 
such as a mouse. In a typical system, additional components may be included in system 14, 
such as a printer or photographic system for producing reconstructed images based upon data 
collected from scanner 14. Although reference is made herein generally to "scanners" in 
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diagnostic systems, that term should be understood to include medical diagnostic data 
acquisition equipment generally. Accordingly, it should not be limited to image data 
acquisition, to picture archiving communications and retrieval systems, nor to image 
management systems, facility or institution management systems, or viewing systems and the 
like, in the field of medical diagnostics. More particularly, the medical resources may include 
imaging systems, clinical diagnostic systems, physiological monitoring systems, and so forth. 

[0020] Similarly, CT system 1 6 will typically include a scanner 42, which detects portions of x-ray 

radiation directed through a subject of interest. Scanner 42 is coupled to a generator and 
^ controller, as well as to a signal acquisition unit, represented collectively as reference numeral 

« : 44, for controlling operation of an x-ray source and gantry within scanner 42, and for receiving 

I: signals produced by a detector array moveable within the scanner. The circuitry within the 

0; controller and signal acquisition components is coupled to a system controller 46 which, like 

€• controller 30 mentioned above, includes circuitry for commanding operation of the scanner and 

T" for processing and reconstructing image data based upon the acquired signals. System 

r controller 46 is linked to a communications module 48, generally similar to communications 

P- module 32 of MRI system 1 4, for transmitting and receiving data for processing at the data 

T processing center 22. Also, the system controller 46 is coupled to an operator station 50, which 

r* includes a computer monitor 52, a keyboard 54, as well as other input devices 56, such as a 

mouse. Moreover, like MRI system 14, CT system 16 will generally include a printer or similar 
device for outputting reconstructed images based upon data collected by scanner 42. 

[0021] Other modality devices will include circuitry and hardware particularly configured for 

acquiring or producing signals in accordance with their particular design. In particular, in the 
case of ultrasound system 18, such systems will generally include a scanner and data 
processing unit 58 for transmitting ultrasound signals into a subject of interest and for 
acquiring resultant signals, which are processed to reconstruct a useful image. The system 
includes a system controller 60, which regulates operation of scanner 58 and which processes 
acquired signals to reconstruct the image. Moreover, system 18 includes a communications 
module 62 for transmitting client data and processing requests between system controller 60 
and the data processing center 22. System 18 also includes an operator's station 64, including 
a monitor 66, as well as input devices such as a keyboard 68. 

[0022] 

Where more than one medical diagnostic system is provided in a single facility or location, 

Page 6 of 36 



as indicated in the case of MRI and CT systems 1 4 and 1 6 in Fig. 1 , these may be coupled to a 
management station 70, such as in a radiology department of a hospital or clinic. The 
management station may be linked directly to controllers for the various diagnostic systems, 
such as controllers 30 and 46 in the illustrated embodiment. The management system may be 
coupled to the system controllers in an Intranet configuration, in a file sharing configuration, a 
client/server arrangement, or in any other suitable manner. The management system also has 
an interface 72, such as a thin client or other suitable computing hardware and software, for 
communicating and interacting with the data processing center 22. An image storage system 
73 is also networked to the interface 72 to provide image storage and retrieval of medical 
h: diagnostic images obtained by the various imaging systems. Moreover, management station 70 

CP will typically include a monitor 74 for viewing system operational parameters, analyzing system 

utilization, and exchanging client data and processing information between the facility 20 and 
y the data processing center 22. Input devices, such as a standard computer keyboard 76 and 

5 mouse 78, may also be provided to facilitate user interaction. It should be noted that, 

L alternatively, the management system, or other diagnostic system components, may be "stand- 

K alone," i.e., not coupled directly to a diagnostic system. Although the data processing center 22 

£v may require a variety of client data (e.g., patient images, medical history, processing criteria, 

etc.) to fully process a client request, the client data may include medical data that is not 
derived directly from the medical system (e.g., CT and MRI systems). The client data may simply 
be transmitted from a client computer (e.g., remote client unit 24) after having been entered by 
the medical client. For example, the client data may be entered via an electronic form, or web 
interface. 

[0023] 

The communication modules mentioned above, as well as workstation 72 and remote client 
unit 24, may be linked to data processing center 22 via a remote access network 80. For this 
purpose, any suitable network connection may be employed. Presently preferred network 
configurations include proprietary or dedicated networks, as well as open networks, such as the 
Internet. Data may be exchanged between the institutions, medical resources, client computers 
and the remote data processing center 22 in any suitable format, such as in accordance with 
the Internet Protocol (IP), the Transmission Control Protocol (TCP), or other known protocols. 
Moreover, certain portions of the data may be transmitted or formatted via markup languages 
such as the HyperText Markup Language (HTML), Extensible Markup Language (XML), or other 
internet and communication languages. Exemplary interface structures and communications 
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components are described in detail below. 

[0024] At the data processing center 22, messages, client requests and client data are received by 
communication components 82 and are transmitted to processing system 84 (e.g., an 
applications server or an applications service provider) via an interface 86. For example, in the 
present technique, the data processing center 22 may receive, handle and process old and new 
images, patient data and other processing criteria to process the desired medical images. In 
general, the processing system 84 may include one or a plurality of computers, as well as 
dedicated hardware or software servers for processing the various requests and for receiving 
and transmitting the information, as described more fully below. The data processing center 22 
& also may include a plurality of applications 88 and databases 90. The applications 88 may 

ffi include image compression and decompression applications, encryption and other security 

W applications, image matching and registration applications, image subtraction applications and 

5 various other applications for analyzing and processing patient records, exams, images and 

U medical data. The databases 90 also may include extensive database information on medical 

O resources (e.g., medical diagnostic imaging systems), a particular medical facility, patient 

iC medical records, and so forth. As described below, the applications 88 and databases 90 may 

£ : be employed both for analyzing the client data (e.g., images) and for processing the request 

P (e.g., image matching and subtraction) transmitted to the processing system 84 by the client. 

The processing system 84 and a portion of the applications 88 also may be disposed on a web 
server. For example, the processing system 84 may include an Internet based image processing 
program configured to guide a client through the steps of compression, matching and 
subtraction. 

[0025] Fig. 2 is a diagram of the communication system 1 0, illustrating an exemplary data flow 

between a client 92 and the data processing center 22. The client 92 may be a medical facility, 
institution or other individual requiring image processing of medical images. The data 
processing center 22 may be associated with a medical supplier, a medical institution, or some 
other entity located remote from the client 92. The client 92 can communicate with the data 
processing center 22 via a communication device 94, which connects to the network 80 and the 
communication components 82 for the data processing center 22. The communication device 
94 may be a modem, a DSL or Ethernet device, or any other suitable network device. The client 
92 then can interact with the processing system 84 by using any suitable interface 96, such as 
a thin client or other platform independent interface. 
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[0026] In this exemplary embodiment, the client 92 interacts with the data processing center 22 
via the interface 94. The interface 94 may be used to determine if image processing is 
necessary and also to provide the appropriate images and data to the data processing center 22 
for image processing. Accordingly, the client 92 enters data, makes appropriate selections, and 
transmits a processing request 98 along with the appropriate new images and old images (if 
local) to the data processing center 22. In the present technique, the images are compressed 
before being electronically transferred to the data processing center 22. By compressing the 
images, the size of the images may be reduced sufficiently (e.g., from 1 5, 1 0, 5 or 2 MB down 
to 1 .5 or 1 MB) to decrease the transfer time for the processing request 98. The images and 
□ corresponding request 98 also may be encrypted prior to electronic transfer. Accordingly, the 

J processing request 98 is routed through the network 80 to the data processing center 22, 

W which may include a plurality of computer systems, servers, workstations, databases, and other 

15 hardware and software applications necessary for processing the images and the corresponding 

i: data and processing criteria. As illustrated, the interface 86 is provided to facilitate interaction 

« with the processing system 84. The interface 86 may include various hardware and software, 

|i such as a web interface (e.g., Internet pages and forms), to facilitate proper data handling and 

processing by the processing system 84 utilizing the applications 88 and databases 90. 



JD027] 



In this exemplary embodiment, the server or processing system 84 has appropriate 
applications 88 (e.g., applications #1 through #N) and databases 90 (e.g., databases #1 
through #N) for analyzing the processing request 98. Accordingly, an image 
compression/decompression program, an image matching/registration program, and an image 
subtraction program may be disposed on the processing system with one or more medical 
resource databases. Using these applications 88 and databases 90, the processing system 84 
generates a processed image 100 that highlights temporally changed features between old and 
new medical images. In the present technique, at least one of the old and new images is 
transmitted to, or retrieved by, the processing system 84 in a compressed format (e.g., using 
various compression techniques). If the client 92 has the interface 96, then the new image(s) 
may be compressed on the client-side prior to electronic transfer over the network 80. 
However, the old image may not be local to the client 92 or it may not be disposed at a medical 
facility having the interface 96. In this situation, the image may be compressed on the server- 
side prior to image matching, subtraction, and other image processing by the processing 
system 84. Alternatively, both the old and new images may be compressed/decompressed to a 
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desired size/resolution on the server-side prior to image processing. If the processed image 
100 is not in a compressed format, then the processing system 84 may perform image 
compression before transmitting the processed image 100 back to client 92. The present 
technique also may utilize a variety of security applications and hardware to protect the images, 
requests and results being communicated over the communication system 10. 

[0028] The processed image 1 00 (e.g., a compressed processed image) and the corresponding 

analysis and results are then transmitted to the client 92 via the communication system 1 0. The 
analysis and results may be formatted by the processing system 84, or they may be transmitted 

r as unformatted data for subsequent formatting by a client server or web server. For example, 

the data processing center 22 may generate user viewable pages (e.g., internet pages) based on 

g". the analysis. The client may then view the pages via the interface 96, which may include an 

Internet browser and other image software. It should also be noted that the data processing 

i : center 22 may provide the analysis and results as a customer-tailored report, which may 

7 incorporate a variety of customer information, system parameters and other unique 

;~ characteristics of the particular customer. 

$0029] Although each client 92 may independently communicate with the data processing center 
f r 22 to remotely process medical diagnostic images, the present technique also may involve 

interaction between a plurality of clients and the data processing center 22, as illustrated in 
Figure 3. The plurality of clients may comprise multiple modalities (e.g., CT f MRI, Ultrasound, 
etc.), multiple business entities, multiple operating systems, and various other differences. 
Figure 3 illustrates an alternate data flow and image processing scheme, which integrates the 
client 92, the data processing center 22, and image storage systems 102 and 104. As 
illustrated, the client 92 communicates through the network 80 via the communication 
component 94 and interacts with the data processing center 22 via the interface 96. The image 
storage systems 102 and 104 communicate through the network 80 via communication 
components 1 1 0 and 1 1 2 and interact with the data processing center 22 via interfaces 1 06 
and 1 08, respectively. The data processing center 22 also has the interface 86, as discussed 
above, to facilitate remote user interaction with the processing system 84 and the 
corresponding applications 88 and databases 90. 

[0030] 

Accordingly, the client 92 may obtain a new image from a medical diagnostic imaging 
system, and then compress the new image to facilitate electronic transfer over the network 80 
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and to the processing system 84. Once the client 92 has obtained a new medical diagnostic 
image, it may be desirable to analyze any changes in the image over a time period. For 
example, if the subject has obtained prior medical diagnostic imaging procedures, then it may 
be desirable to compare the prior and new medical diagnostic images to determine if there are 
any physiological changes in the subject (e.g., a cancerous growth in an organ). The client 92 
may determine if such temporal analysis is necessary or desired, or the client 92 may simply 
send the new image and corresponding patient information to the data processing center 22 for 
analysis. Accordingly, the client 92 may transmit the processing request 98, including the 
compressed new image, to the data processing center 22 via the interface 96. 

1§031] As discussed above, the interface 96 may be a thin client or other platform independent 
i: interface for remote communication with the data processing center 22, which has the actual 

,H applications for processing the image. The typical medical diagnostic image has a relatively 

large file size, such as 1 0 MB. Therefore, the present technique utilizes compression techniques 
IT to reduce the file size and to increase the transfer speed over the network 80. If the client 92 

also has an old image of the subject stored on the image storage system 73, then the client 92 
k may compress and transmit the old medical diagnostic image to the processing system 84 via 

:i: the interface 96. However, as illustrated in Figure 3, the client 92 may not have an old medical 

H : diagnostic image stored locally in the image storage system 73. 

[0032] When the processing request 98 is received at the data processing center 22, the 

processing system 84 performs a search for old medical diagnostic images over the network 80 
to locate images stored at other medical facilities, such as medical facilities having the 
interfaces 106 and 108 and image storage systems 102 and 104, respectively. If the processing 
system 84 locates one or more old images on the image storage systems 102 and 104, then the 
old images may be automatically retrieved from the image storage systems 102 and 104 and 
transmitted to the processing system 84. The images, which may correspond to one or more 
medical modalities, may then be used for image matching and subtraction between the old and 
new medical diagnostic images. It should also be noted that the old images located on the 
image storage systems 102 and 104 may be compressed prior to electronic transfer to the 
processing system 84. 

[0033] 

If the image storage systems 102 and 104 are not coupled to interfaces 106 and 108, such 
as where the image storage systems 102 and 104 are located in medical facilities having 
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incompatible hardware or software and no interface, then the old images may simply be 
retrieved in the fuli uncompressed format by the processing system 84. However, the 
processing system 84 may then compress the old images to the same compression format as 
the new images received by the processing system 84. Image matching and subtraction can 
then be performed on the old and new images in the compressed format. 

[0034] The processing system 84 also may automatically determine the best, or most suitable, of 
the old images to use in the image processing routine. For example, the processing system 84 
may analyze prior health care and various other factors to determine which old image would 
provide the best results for the image subtraction routine. 

;|)035] The processing system 84 then performs image matching and subtraction to provide a 

processed image highlighting the changed physiological features in the subject over time. Once 

ffj the processing system 84 has processed the image(s), the processing system 84 transmits the 

results 1 00 to the client 92 via the network 80. The client 92 may then view the processed 

a image on the interface 96, which may include a variety of imaging software such as an internet 

S: browser. The processed image may be transmitted over the network 80 in a full resolution 

(uncompressed) format or in a compressed format. The compressed format may be the same 

p format as those of the old and new images processed by the processing system 84. It should 

also be noted that the processing system 84 may perform any number of the image processing 
steps, while the remainder of the processing steps may be performed on the client-side with 
the local computing components of the client 92. The processing system 84 also may transmit 
one or more of the old images retrieved from the image storage systems 1 02 and 1 04 and it 
may transmit a deformation field for the image matching process and various other processing 
data. Accordingly, the present technique facilitates integration between the client 92 and the 
data processing center 22 and a plurality of other remote medical facilities and image storage 
systems. 

[0036] 

The present technique utilizes image compression, the client interface, and the remote 
processing scheme to provide platform independent image processing for integrating remote 
medical imaging and storage systems. Accordingly, the present technique performs various 
processing functions on the remote server-side, while reserving some platform independent 
tasks for the client-side. As illustrated in the image processing scheme 1 1 4 of Figures 4A and 
4B, the client 92 may acquire a new medical diagnostic image (block 1 1 6) from one of the 
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medical diagnostic imaging systems and then store the new medical diagnostic image (block 
1 18) in an image storage system, such as the image storage systems 73, 102 and 104. The 
client 92 may then analyze the new medical diagnostic image (block 1 20) and also analyze 
various patient criteria and medical records (block 1 22) to determine if a temporal analysis of 
the new medical diagnostic image and one or more old images is desired (block 124). 

[0037] This analysis (block 124) may be performed manually by a physician, automatically by the 
interface 96 on the client-side, or by the processing system 84. For example, the image 
processing scheme 1 1 4 may automatically evaluate patient medical records, the patient"s age, 
P and various other criteria to determine whether a temporal analysis of the old and new images 

J; is desirable for the treatment of the patient, if it is determined that temporal analysis is not 

S desired, then the image processing scheme 1 1 4 ends (block 1 26) and no further temporal 

pf : analysis of the images is performed. However, if it is determined that temporal analysis is 

J' desired, then the image processing scheme 1 14 proceeds to compress the new medical 

diagnostic image (block 1 28) using compression techniques, such as those illustrated in Figure 
5. Once the new medical diagnostic image has been compressed (block 1 28), then the image 
^ processing scheme 1 1 4 transmits the compressed new image to the remote processing system 

h (block 1 30), such as the processing system 84 of the data processing center 22. The image also 

may be encrypted, or otherwise electronically secured, pnor to transmission. 

[0038] Temporal analysts of medical diagnostic images requires both the new medical diagnostic 
image and also one or more old medical diagnostic images, which may be associated with the 
same or different medical modalities. Accordingly, the image processing scheme 1 1 4 then 
proceeds to locate one or more old images for the subject being evaluated by the present 
technique. The image processing scheme 1 14 determines if there is an old medical diagnostic 
image stored locally on the image storage system of the client 92, If there is an old medical 
diagnostic image stored locally (block 1 32), then the image processing scheme 1 14 proceeds to 
determine whether there are multiple old images stored locally (block 1 34). If there is only one 
old medical diagnostic image stored locally, then the image processing scheme 1 14 proceeds 
to compress the old medical diagnostic image (block 1 36). Once the old image has been 
compressed into the desired format, the compressed old image is transmitted from the client 
92 to the processing system via the network (block 1 38). Again, encryption or other security 
measures also may be used for the electronic transmission. If the image processing scheme 
1 1 4 determines that there are multiple old medical diagnostic images (block 1 34), then the 
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scheme 1 14 proceeds to analyze various selection criteria for choosing the best old image for 
the image processing (block 140). For example, as discussed above, the image processing 
scheme 1 1 4 may evaluate the dates of the images, the size and location of the images, the 
quality of the images, the medical diagnostic systems used to obtain the images, and various 
other factors. Once the image processing scheme 1 14 has analyzed the selection criteria (block 
140), the scheme 1 14 proceeds to select a desired old image (block 142) for comparison and 
processing along with the new image at the processing system 84. The desired old image 
(block 1 42) selected by the scheme 1 1 4 is then compressed (block 1 36) and is transmitted to 
the processing system (block 1 38). The processing system 84 can then proceed to perform 

;r various temporal processing routines 1 70 on the old and new medical diagnostic images, which 

ff : may include images from different modalities. 

!|p039] If the image processing scheme 1 14 determines that there is not a local old image (block 
£i 1 32), then the scheme 1 1 4 searches for old medical diagnostic images on remote image 

J storage systems (block 144). For example, the processing system 84 may search for images of 

y a specific patient at ail medical facilities having the remote image storage systems and desired 

y : medical diagnostic imaging systems, which may have provided images of the desired 

S'l physiological features of the patient. The image processing scheme 1 14 may or may not 

H : discover old desired images for the patient (block 146). If the scheme 1 14 does not discover 

old images for the patient (block 1 46), then the image processing scheme 1 1 4 terminates 

image processing of the new image for the patient (block 1 26). 

[0040] If old images are discovered for the patient (block 1 46), then the image processing scheme 
1 14 proceeds to determine if there are multiple old images disposed on the various remote 
image storage systems (block 148). If multiple old images exist (block 148), then the scheme 
1 14 proceeds to determine whether the remote image storage systems have interfaces, such as 
a uniform interface or thin client interface, which are configured for platform independently 
interacting with the processing system (block 1 50). If the scheme 1 14 determines that the 
multiple old images are disposed on processing systems that include the desired interface 
(block 1 1 5), then the scheme 1 14 proceeds to analyze the selection criteria for the old images 
(block 140). The scheme 1 14 then selects the desired old image based on the selection criteria 
(block 142), compresses the selected old image (block 1 36), and transmits the selected and 
compressed old image to the processing system (block 1 38). 
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[0041] However, if the image processing scheme 1 14 determines that the multiple old images are 
disposed on remote image storage systems that lack the desired interface (block 1 50), then the 
scheme 1 1 4 proceeds to retrieve ail of the multiple old images (block 1 52) and then to analyze 
the various selection criteria for the old images (block 1 54) at the processing system 84. Once 
the image processing scheme 114 has analyzed the selection criteria (block 1 54), then the 
scheme 1 1 4 proceeds to select the desired old image from the multiple old images (block 1 56), 
to compress the selected old image (block 1 58), and then to process the images at the 
processing system 84. 

J0042] If the image processing scheme 1 1 4 determines that there is only a single remote old 
Z~ disposed on one of the remote image storage systems (block 1 48), then the scheme 1 1 4 

0: proceeds to determine if an interface for the processing system is disposed on the remote 

^ E image storage system having the discovered old image (block 160). If the remote image storage 

*p system has the desired interface for the processing system (block 160), then the image 

processing scheme 1 1 4 proceeds to compress the discovered old image (block 1 66). The 
™; scheme 1 1 4 then transmits the discovered and compressed old image to the processing system 

for image processing along with the compressed new image (block 168). However, if the 
I scheme 1 1 4 determines that the remote image storage system does not have the desired 

interface (block 160), then the scheme 1 14 proceeds to retrieve the old image discovered by 
the processing system (block 162). The scheme 1 14 then compresses the old image (block 164) 
for image processing along with the compressed new image at the processing system 84. 

[0043] After tjie p rocesS [ n g system 84 has gathered the desired old and new medical diagnostic 

images (block 1 69), then the image processing scheme 1 14 proceeds with the desired temporal 
processing routines (block 1 70). The processing routines may include a variety of standard and 
custom image processing routines. In an exemplary embodiment of the image processing 
scheme 1 14, the temporal processing routines 1 70 include registering and matching the old 
and new images gathered at the processing system (block 1 72). The registering and matching 
steps also may involve deforming one or more of the old and new images. For example, it may 
be desirable to deform the older image to have the corresponding physiological features 
geometrically matched with the corresponding physiological features of the new image. 
Similarly, images from multiple modalities may be normalized (e,g., to a common coordinate 
system and geometries for specific features) or otherwise matched to facilitate temporal 
subtraction of the desired physiological features. Also, it is desirable to have higher accuracy of 

Page 15 of 36 



the new image, which may have various changes (e.g., a tumorous growth) that the patient and 
physician would like to analyze and review. After the old and new images are 
registered/matched (block 1 72), the temporal processing routines 1 70 proceed to subtract the 
old and new images (block 1 74) to obtain a processed image to temporally changed features 
(block 1 76). Accordingly, the registering/matching and subtraction routines generate a 
subtracted image, which highlights tumors, cancerous growths, and other physiological 
changes occurring over time. 

[0044] It should also be noted that the temporal processing routines 1 70 are performed in 

compressed formats of the old and new images. However, the image processing scheme 1 14 
& may compress or decompress the old and new images to any desired resolution or quality prior 

fV: to performing the temporal processing routines 1 70. Accordingly, the old and new images may 

;i; be processed in any desired resolution and compression format, while the image processing 

scheme 1 14 utilizes image compression to facilitate efficient network transfers over the 
network between the client 92 and the data processing center 22. After the scheme 1 1 4 
O completes the desired temporal processing routines 1 70, the processed image is transmitted to 

[S. the client for further analysis (block 1 78). This transmission also may involve data compression 

Z. and encryption, as discussed above. The additional analysis may include viewing the processed 

h image (block 1 80), and also evaluating the processed image against the new image, the old 

image and various other patient medical information. 

[0045] As discussed above, the present technique may utilize a variety of compression techniques 
to facilitate remote image processing of medical diagnostic images at the processing system 
84. Figure 5 is a diagram of an exemplary image compression routine 182 that may be used 
within the scope of the present technique. As illustrated, the image compression routine 1 82 
begins by initializing a compression routine (block 1 84) that performs a plurality of image 
processing steps to generate a desired compressed image. Accordingly, the image compression 
routine 1 82 may perform sub-sampling on the image (block 1 86), a log operation on the image 
(block 188), quantization on the image (block 190), loss-less compression on the image (block 
1 92), and various other compression routines. The desired compression routines generate a 
compressed image (block 1 94), which has a substantially reduced data size to facilitate more 
efficient network transfers. For example, the image compression routine 1 82 may compress the 
image file by a factor ranging from 1 5-1 to 5-1 . 
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[0046] Medical diagnostic images typically have a relatively large file size, such as 1 0MB or 1 5MB, 
which makes network transfers extremely slow and impracticable. Accordingly, the image 
compression routine 1 82 may compress this image down to a file size ranging from 500KB to 
2MB. In this exemplary image compression routine, the 10MB medical diagnostic image may be 
compressed to a file size of approximately 1 MB. However, as the network efficiencies and the 
medical diagnostic imaging systems are improved, the desired compression of the images may 
change along with the state of the compression routines available. 

[0047] Various other standard and customized compression routines also may be utilized along 
with the routines 182 to obtain the desired compression of the medical diagnostic image(s), 
The sub-sampling routine (block 1 86) also may include a filtering operation and may have sub- 
sampling parameters between 2 and 8. A sub-sampling with a factor of 8 on images with an 
initial pixel pitch of 200 m m will provide a pixel size of 1 .6mm, which is sufficient to detect 
desired physiological features with sizes of 1 cm or more. At the same time, it reduces the 
overall number of pixels (hence the computational time) by a factor of 64. It should also be 
noted that the log operation (block 1 88) may involve a dynamic range reduction of the image. 
The logarithmic function is relevant because the image subtraction needs to work on the 
density images, which are the logarithm of the intensity images. In the case of an input dynamic 
range of 1 4 bits, the output dynamic range could vary between 8 bits and 1 2 bits. The present 
technique may reduce the dynamic range of the medical diagnostic image to 8 bits, which 
would be a significant range reduction since computer materials handle bytes of 8 bits. 
Accordingly, the various image compression routines 182 provide a desired compression ratio 
or image size reduction to facilitate efficient network transfers and remote processing by the 
processing system 84. 

Figure 6 is a diagram illustrating an alternate scheme for the temporal processing routines 
1 70. As illustrated, the old and new medical diagnostic images may be registered/matched on 
the processing system (block 196) to obtain a deformation field for the old medical diagnostic 
image (block 1 98). The deformation field for the old medical diagnostic image and the new 
medical diagnostic image, if not already present on the client-side, may then be electronically 
transmitted to the client for completion of the temporal processing routine 1 70 on the client- 
side (block 200). At the client-side, the deformation field may then be up-sampled (or over- 
sampled) to full resolution (block 202). The old and new medical diagnostic images may then 
be subtracted in full resolution (block 204) on the client-side. Accordingly, a processed image 
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of the temporarily changed features between the old and new medical diagnostic images is then 
obtained by the temporal processing routines (block 206). The client 92 may then view the 
processed image (block 208) via the interface 96. 

[0049] While the invention may be susceptible to various modifications and alternative forms, 
specific embodiments have been shown by way of example in the drawings and have been 
described in detail herein. However, it should be understood that the invention is not intended 
to be limited to the particular forms disclosed. Rather, the invention is to cover all 
modifications, equivalents, and alternatives falling within the spirit and scope of the invention 
as defined by the following appended claims. For example, the invention may be utilized for 

yS image processing between multiple modalities and remote clients, while a variety of image 

%[ compression, encryption, and processing applications may be utilized to provide a temporal 

PJ analysis of the desired images. 



Page 18 of 36 



